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INTRODUCTION 

One  of  the  various  problems  encountered  in  industry  is  that 
o:  instructing  or  training  workers.   A  new  worker  or  a  new  job 
for  an  old  worker  requires  that  the  worker  go  through  a  learning 
p;:ocess  to  enable  him  to  correctly  function  in  his  new  job. 
Often  the  work  instruction  is  given  as  a  written  or  typed  list 
o:  steps  which  has  been  developed  by  the  organization's  indus- 
trial engineering  department.   Sometimes  the  worker  is  given  a 
blueprint  from  which  to  obtain  his  work  instructions. 

One  method  of  attacking  the  training  problem  is  used  by  the 
auto  industry.   Where  cars  are  mass  produced,  the  problem  is 
solved  by  dividing  the  total  job  into  very  small  increments  and 
hiring  as  many  people  as  there  are  increments.   Each  performs 
many  repetitions  of  these  small  increments  of  the  total  job.   By 
tjie  coordination  of  many  workers,  the  autos  are  mass  produced. 
However,  there  are  many  assembly  tasks  which  do  not  lend  them- 
selves to  this  technique,  because  of  complex  design,  limited  pro- 
duction, short  product  life,  or  some  other  factor  requiring  con- 
siderable knowledge  and  skill  on  the  part  of  a  worker.   Increas- 
ing need  for  training  and  instructing  workers  has  brought  about 
now  interest  in  the  learning  process  and  methods  of  instruction 
for  assembly  tasks. 

To  study  the  learning  process  is  to  stand  upon  ground  that 
is  not  completely  explored.   Bugelski  (1) ,  a  psychologist,  has 


said  "A  scientific  theory  of  learning  has  yet  to  be  agreed  upon 
b>/  psychologists". 

Recently,  a  new  method  of  teaching,  prograinmed  instruction 
or  programmed  learning,  has  emerged.   The  pioneer  psychologist  in 
programmed  instruction  is  Sidney  L.  Pressey  (11) .   Pressey  was  an 
O.iio  State  University  psychologist  who  designed  a  machine  for 
tasting  purposes  in  the  early  1920 's.   He  exhibited  his  device 
a.id  presented  papers  discussing  it  at  the  meetings  of  the  Ameri- 
can Psychological  Association  in  1924  and  1925.   His  invention 
was  a  mechanical  device  for  administering  and  scoring  tests.   It 
was  designed  to  incorporate  the  known  principles  of  the  learning 
process  into  a  mechanical  device  which  would  do  some  of  a  teach- 
er's routine  work  and  give  the  teacher  added  time  to  concentrate 
upon  the  more  creative  parts  of  his  work.   Following  his  first 
work,  Pressey  and  his  students  at  the  Ohio  State  University  con- 
tinued to  develop  additional  devices  and  to  try  these  out  experi- 
mantally  with  a  variety  of  course  materials.   Pressey  continued 
his  work  and  wrote  a  few  papers  in  the  1930 's  and  1940 's,  but  the 
"industrial  revolution"  in  education  which  he  visualized  did  not 
take  place  until  about  thirty  years  after  his  first  paper  was 
presented. 

In  1954  B.  F.  Skinner  (11) ,  a  Harvard  psychologist,  pre- 
sented his  paper  "The  Science  of  Learning  and  the  Art  of  Teach- 
iag".   His  thesis  is  that  the  whole  process  of  becoming  competent 
in  any  field  of  endeavor  must  be  divided  into  a  very  large  number 
of  very  small  steps  and  reinforcement  must  be  contingent  upon  the 
accomplishment  of  each  step.   He  also  had  the  design  for  a 


machanical  device  to  present  his  program  to  a  student.   The  next 
decade  witnessed  an  active  attempt  to  implement  his  philosophy  in 
practice  by  producing  programs  and  machines  to  present  and  con- 
trol the  programs  as  used  by  a  student.   In  fact,  the  term 
"teaching  machine"  seems  to  have  emerged  during  this  period  and 
attached  itself  to  the  initial  term  of  programmed  instruction. 
Now  the  term  used  for  the  industry  is  "Teaching  Machines  and  Pro- 
grammed Learning".   Although  the  word  "teaching  machine"  is  a 
misnomer,  it  appears  in  the  literature.   A  teaching  machine  is  a 
mechanical,  electrical,  or  electronic  device  that  controls  the 
presentation  of  the  program,  keeps  a  record  of  the  student's  an- 
swers, and  provides  immediate  feedback  by  displaying  correct  an- 
swers.  A  definition  for  "programmed  instruction"  is  now  due. 
Hughes  (8)  gives  this  definition: 

Prograituned  instruction  is  any  form  of  pre- 
prepared,  pre-sequenced  instruction  directed 
toward  a  specific  educational  or  training  ob- 
jective. 

•  Characteristics  of  programmed  instruction: 

1.  Each  student  works  individually  on  the  programmed  in- 
struction materials  at  his  own  pace. 

2.  A  relatively  small  unit  of  information  is  presented  to 
the  student  at  a  time.   A  statement  to  be  completed,  or 
a  question  to  be  answered,  about  this  information  is 
also  included.   This  is  known  technically  as  the  stim- 
ulus . 

3.  The  student  is  required  to  complete  the  statement  or 
answer  the  question  about  that  specific  bit  of  infor- 
mation.  In  technical  terms,  he  is  said  to  be  making 
a  response  to  the  stimulus  presented.   The  statement 
or  question  is  usually  designed  to  make  it  probable 
that  the  student  will  give  the  correct  response. 

4.  The  student  is  then  immediately  informed  whether  his 
response  is  correct  or  not.   If  it  is  wrong,  he  may 
also  be  told  why.   By  this  kind  of  feedback,  he  is 


rewarded  (told  he  is  correct)  if  he  gives  the  correct 
answer;  in  more  technical  terms,  his  response  is  rein- 
forced.  In  learning  experiments,  psychologists  have 
found  that  reinforcement  increases  the  probability  of 
making  the  correct  response  to  the  same  stimulus  in  the 
future . 

5.   The  student  is  next  presented  with  the  second  unit  of 
information,  and  the  cycle  of  presentation-answer- feed- 
back or,  more  technically,  stimulus-response-reinforce- 
ment of  the  correct  answer  is  repeated.   The  same  cycle 
is  repeated  again  and  again  as  all  of  the  necessary  in- 
formation is  presented  in  a  logical  sequence.   Provision' 
is  also  made  for  the  practice  and  review  of  previously 
learned  information. 

Each  unit  of  information  presented  is  called  a  frame,  because 
when  teaching  machines  are  used,  the  information  appears  through 
a  window  on  the  machine.   A  series  of  such  frames,  presenting  a 
logical  sequence  of  information,  is  called  a  program.   Programs 
nay  run  into  hundreds  or  even  thousands  of  frames,  which  present 
the  subject  matter  step  by  step  in  a  logical  order,  beginning 
vith  the  simpler  concepts  and  advancing  to  the  more  difficult. 
Vvhen  the  student  has  to  compose  the  entire  response,  it  is  known 
cs  a  write-in,  or  constructed  response,  program.   In  another  kind 
cf  program,  the  student  is  presented  with  a  number  of  alternative 
responses  to  the  question  asked  in  a  frame  and  is  required  to 
choose  the  correct  one.   This  program,  similar  in  format  to  an 
objective  achievement  test,  is  known  as  a  multiple-choice  re- 
sponse program.   For  some  programs,  all  students  work  through  the 
same  fixed  sequence  of  frames  determined  by  the  program  writer. 
7  program  of  this  sort  is  called  a  straight-line,  or  linear,  pro- 
cram.   For  other  programs,  each  student  follows  a  sequence  of 
frames  determined  by  his  own  responses.   Such  programs  are  called 
t  ranching  programs . 


Generally,  then,  programs  differ  in  two  respects:  the  mode 
o:'  response  (constructed-response  or  multiple-choice)  and  the  se- 
quence of  frames  (linear  or  branching) .   All  existing  programs 
can  be  classified  according  to  these  two  characteristics.   Most 
Oj'  the  programs  written  at  present  are  of  the  constructed-re- 
sponse, linear  variety.   In  general  the  applications  for  an  assem- 
bj.y  task  are  of  the  constructed-response,  linear  type  of  programs. 

The  branching  programs  are  direct  decendants  of  Pressey's 
multiple  choice  testing  programs.   N.  A.  Crowder  has  developed 
pj-ograms  of  the  multiple  choice  response  and  branching  type  based 
oil  what  he  calls  intrinsic  programming  principles.   Intrinsic  pro- 
gramming means  that  each  student  determines  the  sequence  of 
frames  by  his  responses  to  the  multiple-choice  questions  con- 
tained in  the  frames. 

Since  Skinner's  paper  in  1954,  a  variety  of  programs  have 
been  produced  and  used  in  a  variety  of  situations  and  age  groups. 
Pjograms  have  been  used  in  schools,  in  industry,  in  the  military, 
aid  in  home  study.   Hughes  (8)  says,  "In  almost  every  case  where 
ii.  has  been  used,  programmed  instruction  has  led  to  either  a  re- 
duction in  learning  time  or  an  increase  in  the  knowledge  or  skill 
acquired  by  students,  or  both". 

In  his  1962  survey  of  the  industry,  Finn  (4)  lists  137 
companies.   These  companies  are  producers  of  programs,  writers 
or  programs,  manufactures  of  hardware,  consultants,  or  a  combina- 
tion of  these  functions. 

In  a  survey  of  the  research,  Schramm  (13)  estimates  that 
sr.nce  1954  there  have  been  approximately  190  reports  of  original 


rssearch  on  programmed  instruction.   Of  the  160  papers  he  com- 
piled information  from,  only  18  involved  a  work  related  task. 
Since  a  certain  manufacturer  (17)  claims  that  its  communication 
Sj^stem  can  reduce  production  time,  training  time,  and  rejects, 
aid  little  research  has  been  done  to  investigate  the  application 
of  programmed  instruction  to  production  assembly  tasks,  there  is 
a  need  for  research  in  this  area.   The  remainder  of  this  thesis 
will  be  concerned  with  programmed  instruction  for  a  production 
assembly  task. 

A  comparison  of  the  production  assembly  task  work  instruc- 
tion program  design  criterion  and  characteristics  of  programmed 
iistruction  reveal  similarities.   Both  have  a  specific  instruc- 
tion or  training  goal.   While  it  is  not  always  feasible  to  de- 
scribe the  training  objective  for  some  subjects,  the  production 
assembly  worker  has  a  definite  specified  product  to  produce  from 
his  work.   Both  call  for  an  ordered  sequence  of  items  through 
wiich  the  student  works  in  short  steps.   The  nature  of  the  pro- 
dact  Will  usually  dictate  the  order  of  assembly  and  the  worker 
mast  respond  to  each  item  to  build  the  product.   Both  call  for 
tie  operator  working  at  his  own  pace.   Since  the  product  is  pro- 
duced to  specifications,  the  operator  gets  feedback  from  inspec- 
tions to  reinforce  his  responses. 

Recent  studies  (9,10)  in  the  application  of  programmed  in- 
struction to  assembly  tasks  have  shown  a  significant  decrease  in 
assembly  time  for  workers  using  35  mm  color  slides  projected  in  a 
Hughes  Videosonic  unit  for  their  work  instructions  when  compared 
wLth  conventional  typed  running  lists.   The  term  work  instruc- 
tion is  used  to  indicate  that  the  operator  responds  to  the 


program  for  the  assembly  of  each  unit  and  usually  doesn't  attempt 
to  memorize  the  steps.   Some  of  these  programs  (17)  in  use  in  in- 
dustry have  3210  separate  steps  and  require  65  hours  to  complete 
a  unit.   In  fact, for  programs  of  this  type,  because  of  their 
length,  the  operators  are  requested  to  refrain  from  trying  to 
mamorize  parts  of  the  program  and  rely  entirely  upon  the  programs 
to  insure  uniformity  and  quality  in  the  product. 

Since  slide  projection  equipment  costs  from  $100  to  $600,  it 
would  be  economically  desirable  to  have  work  instruction  programs 
which  would  still  result  in  a  decrease  in  production  time  but 
which  would  not  involve  the  use  of  projection  equipment.   It  has 
been  demonstrated  that  with  certain  equipment  reduction  in  errors 
and  assembly  time  can  be  expected.   This  experiment  was  an  effort 
to  obtain  the  desirable  results  of  this  type  of  work  instruction 
without  the  investment  in  special  equipment.   A  cheaper  type  of 
program,  if  proved  effective,  could  be  used  on  jobs  which  could 
not  economically  justify  the  investment  in  projection  equipment. 

The  idea  that  photographs  can  be  used  to  increase  the  effec- 
tiveness of  instructional  programs  is  not  new.   As  early  as  1936, 
Williams  (16)  cites  an  example  in  which  photographs  were  used  in 
an  instructional  program  for  workers  in  a  shoe  factory. 


METHOD 
Task  Studied 

PLATE  I  shows  the  pegboard  and  parts  used  in  the  experiment. 
Ihe  board  consisted  of  sixteen  vertical  dowels  which  formed  a 
four  by  four  matrix.   The  four  rows  were  labeled  1,  2,    3,  and  4. 
The  four  columns  were  labeled  A,  B,  C,  and  D.   A  layer  was  formed 
by  assemblying  nine  parts  on  the  base.   There  were  three  differ- 
ent kinds  of  parts.   These  parts  were  named  singles,  doubles,  and 
triples,  depending  upon  how  many  holes  were  in  the  part.   The 
nine  parts  for  a  layer  were  five  singles,  four  doubles,  and  one 
triple.   Singles  were  painted  red  on  one  side  and  white  on  the 
other  side,  while  the  doubles  and  triples  were  painted  red  on  one 
end  of  one  side  and  white  on  the  opposite  end  of  the  other  side. 
Each  of  the  three  different  tasks  consisted  of  two  different  lay- 
ers assembled  on  two  different  boards.   Each  layer  of  each  task 
v^as  a  combination  of  the  same  number  and  kind  of  parts.   Each 
subject  assembled  thirty  six  cycles  for  each  of  the  three  tasks 
and  used  a  different  instructional  medium  for  each  task. 

Work  Instruction  Programs 

Three  different  methods  of  giving  the  subjects  the  informa- 
tion needed  to  assemble  the  tasks  were  used;  Photographs,  Model, 
end  Listing.   The  three  tasks  were  labeled  1-2,  3-4,  and  5-6. 
Photographs,  Model,  and  Listing  programs  were  made  for  each  of 
the  three  tasks.   The  photograph  programs  consisted  of  two  five 
ky  seven  color  photographs  of  completed  layers.   Earlier  studies 
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(3,10)  used  a  Hughes  Videosonic  unit  to  project  the  color  slides 
oi  a  back  projection  screen  for  the  subject.   The  photographs 
used  were  a  standard  size  processed  by  Kodak  and  were  slightly 
s nailer  than  the  Videosonic  screen.   Since  economy  of  program 
CDSt  is  desired,  the  standard  size  was  preferred.   A  sample  of 
tiis  type  of  program  is  shown  as  PLATE  II. 

The  model  programs  consisted  of  two  completed  layers  which 
ware  placed  before  the  subject  on  the  work  place  opposite  the 
part  bins.   On  PLATE  III,  the  top  picture  shows  the  work  place 
S5t  up  for  use  of  the  model  program. 

The  listing  programs  were  typewritten  lists  of  the  instruc- 
tions needed  to  assemble  each  of  the  two  layer  tasks.  The  lists 
used  the  column  and  row  labels  to  identify  each  one  of  the  six- 
taen  dowels.  A  sample  of  this  type  of  program  is  shown  on  PLATE 
17.  Note  that  colors  in  the  inspection  sheet  did  not  reproduce. 
Tie  red,  white  and  wood  had  high  contrast  in  the  actual  inspec- 
tion sheet. 

Subjects 

Eighteen  subjects  were  obtained  through  the  Kansas  State  Em- 
ployment Service  and  from  Kansas  State  University  students  who 
responded  to  circulars  posted  at  various  locations  on  the  campus. 
Since  a  large  portion  of  the  production  assembly  work  in  the 
electronics  industry  is  performed  by  women,  only  female  subjects 
w2re  used.   The  average  age  was  approximately  twenty  years  with  a 
range  from  18  to  22  years.   The  average  number  of  school  years 
CDmpleted  was  13.8  with  a  range  from  12  to  16.5.   The  subjects 


EXPLANATION  OF  PLATE  II 

Photographs  program  for  task  1-2.   The  top 
photograph  was  for  layer  1  and  the  bottom 
photograph  was  for  layer  2.   For  the  exper- 
iment, 5  by  7  inch  color  photographs  were 
used. 
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PLATE    II 


EXPLANATION  OF  PLATE  III 

Top  photograph  shows  the  work-place  used  in  the 
experiment  set  up  for  use  of  the  Model  program. 
Bottom  photograph  shows  subject  picking  up  first 
part  to  begin  an  assembly  cycle. 
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PLATE    III 


EXPLANATION  OF  PLATE  IV 

Top:   Listing  program  for  Task  1-2. 
Bottom:   Inspection  sheet  for  Task  1-2, 
Colors  did  not  reproduce .   Inspection 
sheets  were  red,  white,  and  natural 
wood.   Sheet  is  shown  actual  size. 


PLATE  IV 


Task  1-2 

1.  Get  5  singles 

2.  White  a  Al,  Dl,  Dl|. 

3.  Red  at  02,  Ci^. 

4.  Get  I4.  doubles 

5.  White  up  at  D2,  D3 

60  White  right  at  A2,  B2 

7.  White  left  at  AI4.,  Bi^. 

8.  Red  left  at  Bl,  Gl 

9.  Get  1  triple 

10.  Red  left  at  A3,  B3,  C3 
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11.  Get  5  singles 

12.  White  at  M\.,   Bl,  D3 

13.  Red  at  BI4.,  DiJ, 

11]..  Get  1|.  doubles 

15.  White  left  at  Gl,  Dl 

16.  Red  up  at  Al,  A2 

17.  Red  down  at  G3,  Gi; 

18.  Red  left  at  A3,  B3 

19.  Get  1  triple 

20.  White  right  at  B2,  G2,   D2 
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were  paid  $4.00  -for  their  work,  and,  on  the  average,  they  worked 
for  about  three  hours. 

Work  Place 

The  standard  work  place  used  by  each  subject  is  shown  as 
PIiATE  V.   The  part  bins  were  placed  on  the  right  hand  side  for 
right  handed  persons  and  placed  on  the  left  hand  side  for  left 
hcnded  persons.   PLATE  II  shows  a  subject  at  the  work  place. 

Data  Format 

Each  layer  that  a  subject  assembled  was  timed  and  checked 
for  errors.   The  time  was  measured  from  the  instant  the  subject 
r€:ached  for  the  first  part  until  the  last  part  was  in  place. 
Time  was  measured  with  a  decimal  minute  stop  watch  and  was  re- 
corded to  the  nearest  1/100  of  a  minute.   Each  layer  was  in- 
spected by  comparing  it  to  a  standard.   The  standard  was  a  raina- 
ti.re  color-coded  top  view  of  a  task.   The  inspection  sheet  for 
tc sk  1-2  is  shown  on  PLATE  IV.   Errors  were  classified  five  ways: 
pc'sition  (on  wrong  pegs  whether  up  one  peg,  down  one  peg,  right 
oi  e  peg,  or  left  one  peg) ,  orientation  (on  correct  pegs  but  with 
er ds  reversed  or  part  upside  down),  color  (on  correct  pegs  but 
with  wrong  color  showing),  omission  (part  omitted),  and  other 
(cny  error  which  did  not  fit  into  the  above  categories) .   Parts 
cculd  be  out  of  position  more  than  one  peg  in  a  direction  or 
p£  rts  could  be  over-lapped  by  putting  more  than  one  part  on  a 
peg.   If,  for  some  reason,  the  entire  layer  was  incorrect,  it  was 
sc:ored  as  nine  "other"  errors.   To  facilitate  the  collection  of 


u 

•v 

(U 

c 

^ 

ea 

u 

0 

U) 

s 

'd 

n 

^3 

ro 

C 

0 

(0 

XI 

x: 

tp 

■p 

c 

x: 

•H 

t7^ 

c 

•H 

> 

0 
•H 

V^ 

w 

4J 

^ 

• 

E-" 

•H 

o 

(U 

< 

to 

<w 

N 

►q 

0 

•H 

CU 

& 

0. 

3 

to 

h 

tP 

x: 

O 

c 

-P 

-p 

-H 

QJ 

M 

3 

S 

to 

d 

O 

0 

o 

H 

x: 

to 

m 

Eh 

w 

•H 

1 

< 

OJ 

Q) 

Q) 

c 

■^ 

O 

O 

0 

h^ 

rO 

(0 

CU 

•H 

rH 

c 

X 

Ou 

cx 

15 

a 

M 

,v 

0 

U 

>-( 

x: 

0 

0 

to 

S 

s 

m 

M-l 

•H 

O 

« 

to 

<u 

S 

c: 

o 

Q) 

•H 

(d 

•H 

ja 

iH 

> 

cu 

+j 

^ 

04 

M 

^ 

0 

(0 

0 

i-* 

a 

3: 

20 


a 


-P 

(0 

(0 

^ 

3 

<U 

0) 

•m 

a 

>i 

•H 

o 

m 

^ 

+) 

jC 

rM 

O 

+J 

0 

OJ 

0) 

r-\ 

j:: 

c 

> 

ja 

■p 

•H 

iH 
(U 

0) 

en 

Tl 

s 

x: 

C 

(U 

+J 

H 

•H 

T3 

'O 

V^ 

M 

W 

0 

0 

• 

O 

O 

•w 

-P 

o 

<U 

C 

(1) 

M 

-n 

H 

(U 

M 

(U 

> 

e 

CO 

w 

•H 

V^ 

(0 

3 

w 

M 

0 

> 

B 

<1) 

M-l 

03 

< 

a 

m 

nJ 

t-q 

x 

W 

^ 

S 

C^ 

Q) 

03 

0 

^ 

u 

e 

Eli 

0) 

u 

u 

O 

j:: 

r 

(U 

o 

4-» 

U 

»w 

2 

(U 

»w 

O 

c 

>1 

o 

(d 

H 

•H 

»0 

4J 

Eh 

iH 

>^ 

«3 

< 

-o 

= 

u 

-d 

§ 

(1) 
w 

TI 

c 
(1) 

0) 

vJ 

3 

M 

3 

c: 

0^ 

O 

ty 

o 

X 

g 

S 

0) 

M 

V4 

^ 

0 

(U 

M-l 

• 

U-l 

-C 

w 

+J 

<U 

Ai 

<T3 

x; 

O 

J-) 

«4-l 

Eh 

0 

«c 

0 

t-\ 

-o 

■p 

• 

XI 

«w 

x; 

^ 

dJ 

0 

Di 

(U 

4J 

•H 

>i 

nJ 

«w 

u 

m 

•H 

r-1 

rH 

M 

(0 

<u 

a 

43 

4J 

10 

0 

Ou 

M 

a 

O 

o 

0 

cu 

E-« 

+j 

«M 

rO 

22 


1 


C 

- 

Q 

r? 

V  / 

(0 

X 

(0 

) 

d)    1j 
^    (0 

/\ 

/\ 

)  — 

Ss. 

SI 

4-    U     S     O 

(A)                 0  0    0  u 

1 

CL 

0 
0 

0 

O 

\* 

\  J 

\  / 

U       M. 

(0 

X 

(0 

X 

U    fJ    (0'    u 

0^_l  D  D  ^  5    ^    0 

t  ^  ^  o 

(0                   0  0   0  g 

X     ^     r-"       (0         , 

( 

& 

^r!" 
M  CL 

Q  . 

h 

0),  . 

n 

J 

\ 

v/ 

r; 

in 

f 

)< 

CO 

y 

)        i 

c 

0  "C  E   o 

^ 

CO                   0    00    o 

0   0    S 

m 

0 

Nl 

L 

23 

data,  data  sheets  were  printed  v/ith  space  available  for  recording 
the  time,  the  kind  of  errors,  the  number  of  errors,  and  what  type 
o:  part  (single,  double,  or  triple)  was  involved.   A  sample  data 

4 

sheet  form  is  shown  as  PLATE  VI. 

Design  of  Experiment 

The  purpose  of  the  experiment  was  to  test  the  effectiveness 
of  three  different  types  of  work  instruction  programs.   The  effec- 
tiveness was  measured  in  terms  of  the  time  used  to  assemble  the 
units,  the  frequency  and  type  of  errors  found  in  completed  units, 
a;id  preference  of  subject. 

Learning,  fatigue,  and  change  in  the  subject's  interest  in 
t'le  experiment  were  taken  into  account  by  the  experimental  design. 
Eich  subject  served  as  her  own  control  by  assemblying  units  using 
e  ich  of  the  three  types  of  programs.   The  order  in  which  the  sub- 
ji2Cts  used  the  three  programs  was  counterbalanced.   That  is,  three 
s abjects  used  each  of  the  six  sequences:  photographs-model-list, 
piotographs-list-model ,  list-model-photographs ,  list-photographs- 
model,  model-photographs-list,  and  model-list-photographs.   The 
tiree  tasks,  1-2,  3-4,  and  5-6,  were  balanced  into  these  six  se- 
quences.  Each  task  was  used  first  six  times,  second  six  times, 
aid  last  six  times.   The  subjects  were  assigned  to  the  sequences 
by  use  of  a  random  number  table.   Table  1  shows  a  schedule  of  the 
sequences  as  they  were  used  by  the  subjects. 

The  work  was  done  by  each  subject  at  one  session.   Each  sub- 
ject assembled  36  two  layer  tasks  for  each  of  the  three  media. 
Wien  the  subject  had  completed  her  work,  she  was  asked  which 


Table  1.   Experimental  sequence  for  each  subject. 
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Subject 


1st  Medium 
and  task 


2nd  Medium 
and  task 


3rd  Medium 
and  task 


1 
2 
3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 


P-3,4 

L-5,6 

M-1,2 

M-3,4 

P-5,6 

L-1,2 

L-3,4 

P-5,6 

M-1,2 

P-1,2 

L-3,4 

M-5,6 

M-1,2 

L-3,4 

P-5,6 

M-1,2 

P-3,4 

L-5,6 

P-1,2 

M-3,4 

L-5,6 

M-3,4 

L-5,6 

P-1,2 

P-5,6 

L-1,2 

M-3,4 

L-1,2 

P-3,4 

M-5,6 

M-5,6 

P-1,2 

L-3,4 

L-5,6 

P-1,2 

M-3,4 

P-5,6 

M-1,2 

L-3,4 

L-5,6 

M-1,2 

P-3,4 

L-3,4 

M-5,6 

P-1,2 

P-3,4 

M-5,6 

L-1,2 

M-5,6 

L-1,2 

P-3,4 

L-1,2 

M-3,4 

P-5,6 

L  =  Listing  program 

P  =  Photographs  program 

M  =  Model  program 

1,2  =  Task  1,2 

3,4  =  Task  3,4 

5,6  =  Task  5,6 
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nedium  she  liked  the  best  and  which  medium  she  liked  the  least. 

The  subjects  were  given  the  following  instructions  verbally 
prior  to  beginning  their  work. 

1.  Work  quickly  but  accurately. 

2.  For  the  listing,  you  may  want  to  keep  your  place  with 
your  left  hand. 

3.  Use  your  preferred  hand  only  to  place  the  parts  on  the 
board.   (other  hand  could  be  used  to  hold  parts) 

4.  You  may  correct  errors  that  you  notice  before  each  cycle 
is  completed. 

5.  Your  work  will  be  timed  and  checked  for  errors.   (the  sub- 
jects were  not  given  any  feedback  during  the  experiment) 

6.  For  the  picture  programs,  assemble  the  top  layer  first  and 
then  assemble  the  bottom  layer.   For  the  model,  assemble 
the  left  layer  first  and  then  assemble  the  right  layer. 

7.  Place  the  five  singles  on  first,  the  four  doubles  on  sec- 
ond, and  the  triple  on  last  for  each  layer  of  each  medium. 

The  above  instructions  constitute  a  certain  work  method.   Each 
subject  used  the  same  method.   The  subjects  still  had  freedom  to 
vary  the  assembly  method  within  the  singles  and  within  the  doubles, 
but  each  one  put  the  parts  on  in  the  singles-doubles-triple  se- 
quence.  The  experiment  was  subject  paced. 
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RESULTS 

The  average  times  for  the  nedia  were  model:  0.339,  photo- 
craphs:  0.363,  and  listing:  0.524  minutes/layer.   See  Table  2, 
Table  4,  Appendix  I,  and  Appendix  II.   From  the  two-way  analysis 
cf  variance,  Table  4,  it  was  concluded  that  there  is  a  signifi- 
cant difference  (a  =  0.01)  among  the  media.   The  averages  were 
tested  with  Wilcoxon  Signed-Ranks  Tests.   The  model,  photographs, 
end  listing  were  significantly  different  (a  =  0.005)  from  each 
ether. 

The  total  errors  for  the  media  were  model:  34,  photographs: 
51,  and  listing:  187.   See  Table  3,  Table  5,  Appendix  III,  and 
i^ppendix  IV.   The  data  for  errors  was  subjected  to  an  analysis  of 
variance.   From  the  analysis  of  variance,  it  was  concluded  that 
there  is  a  significant  difference  (a  =  0.01)  among  the  media. 
Both  model  and  photographs  were  more  accurate  than  the  listing 
(a  =  0.005)  ,  but  there  was  no  significant  difference  between  the 
model  and  the  photographs. 

Since  all  of  the  subjects  did  not  use  the  media  in  the  same 
sequence,  the  effect  of  sequence  was  tested  in  the  analysis  of 
variance.   For  both  time  and  errors,  the  effect  of  sequence  was 
not  significant.   For  time,  the  effect  of  subjects  within  se- 
quence was  significant  (a  =  0.01).   For  errors,  the  effect  of 
subjects  within  sequence  was  significant  (a  =  0.05).   This  is 
what  would  be  expected. 

According  to  the  opinion  survey,  the  subjects  liked  the 
model  best  and  the  listing  least.   See  Table  6. 
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Thus,  from  all  three  criteria,  the  model  is  best  and  the 
listing  worst. 

Types  of  errors  for  each  medium  are  given  in  tables  7,  8, 
and  9.   The  two  largest  types  of  errors,  orientation  and  color, 
were  compared  with  a  Wilcoxon  Matched-Pairs  Signed-Ranks  Test  (14) 
for  the  three  media.   See  Table  10.   For  orientation  errors,  the 
listing  was  worse  than  the  photographs  and  worse  than  the  model. 
The  photographs  were  equal  to  the  model.   For  color  errors,  the 
list  was  worse  than  the  photographs  and  worse  than  the  model. 
The  photographs  were  equal  to  the  model. 

During  the  experiment,  the  subjects  assembled  a  total  of 
3,888  layers  or  38,880  parts.   Each  layer  was  composed  of  five 
singles,  four  doubles,  and  one  triple.   It  is  interesting  to  note 
that  when  the  parts  are  divided  into  two  groups,  singles  and 
doubles  +  triples,  a  large  difference  is  observed  in  the  number 
of  errors  for  each  group.   See  Table  11.   For  each  group  of  parts, 
there  were  19,440  opportunities  for  errors.   There  was  a  total  of 
4  7  errors  made  on  singles  and  22  5  errors  made  on  doubles  +  tri- 
ples.  For  the  model  or  photographs,  errors  increased  by  a  fac- 
tor of  two  when  the  "simple"  single  was  made  "complex".   For  the 
listing,  however,  errors  increased  by  a  factor  of  eleven  when 
complexity  was  increased. 


28 


Table  2.   Average  time  (minutes  per  layer)  for  each  subject. 
Subject  Photographs  Model  Listing 


.471 
.501 
.559 
.528 
.394 
.877 
.474 
.504 
.522 
.740 
.326 
.498 
.440 
.499 
.432 
.522 
.563 
.580 


1 

.295 

.267 

2 

.340 

.345 

3 

.392 

.370 

4 

■   .478 

.404 

5 

.324 

.319 

6' 

.513 

.426 

7 

.338 

.280 

8 

.380 

.374 

9 

.335 

.354 

10 

.428 

.405 

11 

.252 

.265 

12 

.394 

.322 

13    . 

.323 

.297 

14 

.334 

.332 

15 

.335 

.312 

16 

.344 

.312 

17 

.361 

.356 

18 

.370 

.359 

Average 


.363 


.339 


.524 


Table  3.   Total  errors  for  72  layers  for  each  subject. 
Subject  Photographs  Model  Listing 


1 
2 
3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 


2 

1 
1 
1 
2 
9 
0 
2 
2 
1 
6 
8 
1 
5 
1 
3 
1 
5 


1 
0 
1 
4 
4 
6 
1 
0 
2 
2 
1 
0 
2 
3 
3 
1 
0 
3 


9 
0 
3 
3 

32 
34 

7 
12 

9 

8 

0 
12 

2 
10 

4 
19 

3 
20 


Average 


2.83 


1.89 


10.39 
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Table  4.   Summary  of  analysis  of  variance  for  assembly  times, 
Source d.f . S.S. M.S. F 

Batween  Subjects  17 

Sequence  5 

Subjects  within  12 
Sequence 

Madia  2 

Rasidual  34 


Total   53 


0.040 

0.008 

0.41 

0.232 

0.019 

7.42** 

0.364 

0.182 

70.00** 

0.088 

0.0026 

'p    <    .01 


Table  5.   Summary  of  analysis  of  variance  for  errors 
Source  d.f.      S.S.       M.S.         F 


Between  Subjects  17 

Sequence  5 

Subjects  within  12 

Sequence 

Madia  2 

Rasidual  34 


Total   53 


72.2 
830.8 

781.4 
971.6 


14.44 
69.23 

390.70 
28.58 


0.21 
2.42* 

13.67** 


** 


E 


01 


^£  <  .05 


Table  6.   Summary  of  opinion  survey. 
Model Photographs 


Listing 


Liked  best 
Liked  least 


9 
2 


6 

5 


3 

11 


+  7 


+1 


-8 
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Table 

7. 

Summa: 

Single 

Position-  right 
left 

one 
one 

0 
0 

up 
down 
Orientation 

one 
one 

0 
0 
0 

Omission 

Color 

Other 

6 

14 

0 

Summary  of  errors  for  photographs. 
Doubles   Triples   Total 


Total 


20 


0 
0 
0 
0 
16 
2 
5 
4 

27 


0 
0 
0 
0 
2 
0 

1 
1 


51 


Table  8 

Sui 

Singli 

Position- 

right 
left 

one 
one 

0 
0 

up 
down 
Orientation 
Omission 
Color 
Other 

one 
one 

0 
0 
0 
3 
8 
0 

Summary  of  errors  for  model. 

Doubles   Triples   Total 


Total 


11 


0 
0 
0 
0 
15 
2 
0 
0 

17 


0 
0 
0 
3 
2 
0 
1 
0 
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Table  9. 

Sum] 

Singli 

Position-  right  one 
left  one 

0 
0 

up  one 
down  one 
Orientation 

0 
0 
0 

Omission 

Color 

Other 

0 

16 

0 

Summary  of  errors  for  listing. 


Doubles 

Tripl< 

0 

0 

0 

0 

0 

0 

0 

1 

126 

10 

2 

0 

25 

7 

0 

0 

Total 


Total 


16 


153 


18 


187 
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Table  10.   Distribution  of  orientation  and  color 
errors  among  media. 


Model 

Photographs 

Listing 

Orientation 

17 

18 

136 

Color 

9 

20 

48 

Table  11.   Distribution  of  single  type  errors 
and  (double  +  triple)  type  errors 
among  media . 


Model 


Photographs        Listing  Total 


r.ingles  11 


Doubles  +  Triples     23 


20 
31 


16 


171 


47 


225 
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DISCUSSION 

Mccormick  (12)  says  that  in  performing  any  type  of  work,  a 
person  engages  in  essentially  three  kinds  of  functions. 

1.  The  first  of  these  is  one  of  obtaining  information. 
This  occurs  largely  through  the  various  sense 
organs,  especially  the  eyes  and  ears,  but  also 
through  the  other  senses. 

2.  The  second  function  is  that  of  making  decisions. 
These  decisions  are  made  on  the  basis  of  the  infor- 
mation obtained  through  the  sense  organs,  in  inter- 
action with  the  knowledge  that  is  "stored"  in  the 
individual. 

3.  The  third  function  is  that  of  acting  upon  the  de- 
cisions.  In  many  jobs  this  action  is  of  a  physi- 
cal nature,  as  in  operating  control  devices  or  in 
using  tools.   In  other  jobs,  this  action  is  a 
communication,  usually  oral  or  written. 

For  the  listing,  the  subject  must  gather  information,  interpret 
tiat  information,  and  act  upon  that  interpretation  in  the  form  of 
assemblying  a  part  on  the  pegboard.   He  may  or  may  not  interpret 
t;ie  information  correctly,  and  if  he  interprets  it  incorrectly, 
his  response  also  (except  by  chance)  will  be  incorrect.   The  in- 
formation is  in  the  form  of  letters  and  numbers.   These  symbols 
must  be  related  to  the  pegboard  and  available  parts  and  the  cor- 
r(jct  response  visualized.   This  process  must  be  repeated  for  each 
s  :ep  in  the  assembly  of  the  unit. 

For  the  photographs,  the  subject  can  visualize  the  informa- 
t;.on  without  any  symbols  and  formulate  his  response.   Because  the 
subject  can  formulate  his  response  without  the  use  of  symbols 
and  without  interpretation,  he  can  respond  faster  and  make  less 
ej.-rors  on  the  photographs  program  as  compared  to  the  typewritten 
l:^sting. 
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The  assembled  units  used  as  models  in  assemblying  other 
uiits  serve  the  same  function  as  the  photographs.   However,  from 
tie  data,  one  would  suspect  that  the  model  is  a  little  better 
tian  the  photographs.   This  could  possibly  be  attributed  to  the 
fact  that  the  photographs  do  not  give  as  clear  information  as  one 
can  obtain  from  looking  at  the  model  itself.   Photographs  could 
b2  improved  by  using  different  colors  that  will  show  proper  con- 
trast when  photographed. 

An  examination  of  the  summary  of  all  errors  made  shows  that 
tie   subject  made  almost  no  "position"  or  "other"  errors.   More 
tian  96%  of  the  errors  made  were  in  the  "orientation",  "color", 
aid  "omission"  categories.   More  than  46%  of  the  errors  were 
"orientation-doubles"  observed  from  subjects  using  the  listing 
programs.   Also,  the  error  having  the  highest  frequency  for  both 
model  and  photograph  programs  was  the  "orientation-double".   These 
ooservations  suggest  that  there  is  an  assignable  cause  behind 
b >th  the  "orientation-double"  part  and  the  listing  program.   For 
tie  "orientation-double"  part,  the  writer  would  attribute  the 
high  number  of  errors  on  all  types  of  programs  to  the  fact  that 
tie  correct  response  and  the  incorrect  response  were  different 
i.i  only  one  respect.   Both  had  the  part  on  the  same  pegs  and  had 
tie  same  color  showing,  but  the  correctness  of  the  response  was 
determined  from  which  peg  the  color  end  of  the  part  was  placed. 
Tius,  it  seems  that  the  less  distinct  an  incorrect  response  is 
from  the  correct  response,  the  more  likely  a  subject  will  make  an 
iicorrect  response,  given  that  there  is  an  equal  opportunity  for 
both  the  correct  and  incorrect  responses. 
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The  v;riter  would  attribute  the  high  number  of  "orientation- 
double"  errors  from  the  listing  program  to  the  lack  of  reinforce- 
m(;nt.   Since  the  subjects  received  no  feedback  from  the  experi- 
menter, they  didn't  know  whether  they  were  responding  correctly 
o.-  not.   Also,  they  could  form  an  incorrect  response,  assume  it 
was  correct,  and  then  repeat  it  many  times  during  the  experiment. 
As  a  clinical  observation,  the  experimenter  would  say  that  "neg- 
aiiive  reinforcement",  which  is  the  situation  described  above, 
actually  happened  during  the  experiment.   This  lack  of  reinforce- 
m<:nt,  as  Mr.  B.  F.  Skinner  says,  is  a  violation  of  the  basic 
principles  of  the  learning  process.   The  model  and  photograph 
programs  offered  the  subject  a  more  realistic  standard  to  compare 
h;.s  work  against  than  that  offered  by  the  listing  program.   A 
subject  could  obtain  reinforcement  from  the  photograph  and  model 
programs  which  was  not  available  from  the  listing  program.   This 
a<rrees  with  the  study  of  Cross,  Noble,  and  Trumbo  (3)  in  which 
tliey  found  that  it  was  more  effective  to  present  a  picture  of 
what  the  operator  should  duplicate  than  to  give  the  operator 
typed  directions  on  what  to  do. 

From  previous  work  (10) ,  their  experiment  four  is  the  most 
ur.eful  for  comparing  with  this  current  work.   See  table  12. 
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Table   12.      Comparison   of  previous   and 
current  experiments. 


Experiment  Four 


Current 


:'ask 

f.ubjects 

i.verage  years  of 
£  chool  completed 
by   subjects 

Layers  assembled 
per  medium/subject 

I'edia 

Average  time  per 
layer    (minutes) 

1 veraqe  errors  per 
]  ayer 

I atio  of  times 


I atio  of  errors 


pegboard 

students 
14.5 

48 


pegboard 
students 
13.8 

72 


listing-35mm  slides   lis ting-photos -model 


0.72    0.40 


0.52     0.36    0.34 


0.22 


0.07 


0.14 


0.04 


0.03 


slides/listing 
.40/. 72=56% 

slides/listing 
.07/. 22=32% 


photo/list  model/list 
.36/. 52=69%  .34/. 52=65% 

photo/list  model/list 
.04/. 14=29%  .03/. 14=21% 


Percentage  wise,  the  effect  of  using  the  photographs  or  the  model 
V  as  approximately  equal  to  the  effect  of  using  the  35mm  color 
Elides  when  compared  against  the  conventional  listing.   There 
doesn't  seem  to  be  any  reason  why  a  direct  comparison  of  these 
two  experiments  is  not  valid.   Thus  it  seems  that  the  advantage 
from  using  slide  projection  equipment  comes  from  the  picture 
itself  and  not  from  the  equipment.   Color  photographs  would  do 
just  as  well  and  possibly  better  for  presenting  a  picture  to  an 
cssembly  worker. 
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CONCLUSIONS 

Based  upon  the  data  of  this  experiment,  the  model  programs 
and  the  photograph  programs  were  both  better  than  the  listing 
program.   The  statement  is  true  whether  time,  errors,  or  prefer- 
€ince  is  used  as  the  measure  of  effectiveness.   Although  the  model 
programs  and  the  photograph  programs  showed  a  statistical  differ- 
ence in  times  but  not  errors,  a  clinical  observation  of  the  data 
would  indicate  that  the  model  program  is  the  better  of  the  two. 
In  situations  where  it  would  be  practical,  models  could  be  used 
l:>y  production  assembly  workers  in  assemblying  units.   Where  mo- 
dels would  not  be  practical,  perhaps  because  of  their  size  or  the 
nultiplicity  of  steps,  photographs  could  be  used. 

There  are  still  many  questions  that  remain  unanswered  and 
Lhere  is  a  need  for  continued  research  in  training  industrial 
v'orkers.   How  can  tasks  which  would  be  profitable  applications  of 
programmed  instruction  be  identified?   At  least  two  experimenters, 
f'oldman  and  Hart  (6)  ,  say  that  the  key  is  in  the  information  con- 
tent of  the  task  and  "information  theory"  can  be  used  to  analyze 
end  compare  tasks. 

The  purpose  of  the  experimenter  was  to  gather  evidence  to 
E upport  the  hypothesis  that  color  photographs  and/or  models  could 
1:  e  an  inexpensive  application  of  programmed  instruction  to  situa- 
tions which  could  not  economically  justify  projection  equipment. 
Ihe  data  collected  has  sustained  this  hope.   Since  much  of  the 
V ork  of  production  is  done  from  information  obtained  from  type- 
V ritten  listings  or  blueprints,  there  is  probably  a  potential 


37 


savings  on  many  jobs  that  could  be  realized  by  a  successful  ap- 
j)lication  of  programmed  instruction  to  assembly  tasks.   These 
applications  would  not  necessarily  involve  an  investment  in  pro- 
jection equipment. 
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APPENDIX  I 

Time  Calculations  for  ANOVA  of  Table  4 

Subjects   Photographs  Model  Listing  Total 

X       X2      X       X2  X  X2  X  X2 

1.  .295  .087025  .267  .071289  .471  .221841  1.033  1.067 

2.  .340  .115600  .345  .119025  .501  .251001  1.186  1.407 

3.  .392  .153664  .370  .136900  .559  .312481  1.321  1.745 

4.  .478  .228484  .404  .163216  .528  .278784  1.410  1.988 

5.  .324  .104976  .319  .101761  .394  .155236  1.037  1.075 

6.  .513  .263169  .426  .181476  .877  .769129  1.816  3.298 

7.  .338  .114244  .280  .078400  .474  .224676  1.092  1.192 

8.  .380  .144400  .374  .139876  .504  .254016  1.258  1.583 

9.  .335  .112225  .354  .125316  .522  .272484  1.211  1.467 

10.  .428  .183184  .405  .164025  .740  .547600  1.573  2.474 

11.  .252  .063504  .265  .070225  .326  .106276  0.843  0.711 

12.  .394  .155236  .322  .103684  .498  .248004  1.214  1.474 

13.  .323  .104329  .297  .088209  .440  .193600  1.060  1.124 

14.  .334  .111556  .332  .110224  .499  .249001  1.165  1.357 

15.  .335  .112225  .312  .097344  .432  .186624  1.079  1.164 

16.  .344  .118336  .312  .097344  .522  .272484  1.178  1.388 

17.  .361  .130321  .356  .126736  .563  .316969  1.280  1.638 

18.  .370  .136900  .359  .128881  .580  .336400  1.309  1.713 

Totals    6.536  2.439    6.099  2.104    9.430  5.197    22.065  27.865 

;iverage    .363  .339  .524  .409 

X  =  Average  time  for  72  layers  (36  two-layer  tasks)  by  1  subject 
Sum  X2  =  9.740 
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Sibjects        Sequence  Subject  total   Sequence  total 

photographs-model-listing 
7  1.092 

L3  1.060 

L6  1.178 


3.330 


photographs-li sting-model 

1  1.033 

4  1.410 

9  1.211 


TrSSA" 


model-photographs-listing 

2  1.186 

6  1.816 

LI  0.843 


3.845 


model- lis ting-photographs 

5  1.037 

8  1.258 

L7  1.280 


3.575 


listing-photographs-model 

3  1.321 

LO  1.573 

L2  1.214 


4.108 


listing-model-photographs 

L4  1.165 

L5  1.079 

L8  1.309 


3.553 

{:;um  X)2/N  =  (22.065)2/54  =  486.86/54  =  9.016  =  correction  factor 

Siiquence 

( 5.3302+3. 654^3. 845^3. 5752+4. 1082+3. 5532)/9  =  9.056 

9.056-9.016  =  0.040  =  Sum  x2 

Total 

9.740-9.016  =  0.724  =  Sum  X^ 

Botween  Individuals 
27.865/3-9.016  =  0.272  =  Sum  x2 

Between  Experimental  Conditions 
((S. 5362+6. 0992+9. 4302)/18  -  9.016  =  0.364  =  Sum  x2 
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Subjects  Within  Sequence 


Sum  X2  -  Sum  X^  =  0.272-0.040 

Bl  b 


Fesidual  (experimental  error) 
0.724-0.272-0.364  =  0.088 


0.232  =  Sum  X2g 


Source  of  variation 

df 

Sum  X2 

ms 

Subjects 

Sequence 

Subjects  X  Sequence 
Nedia 
Error 

17 
5 

12 
2 

34 

0.040 
0.232 
0.364 
0.088 

.040/5  =  0.008 
.232/12  =  0.0193 
.364/2  =  0.182 
.088/34  =  0.0026 

F  ratios 


Sequence  .008/. 0193  =  0.4145 

Subjects  X  Sequence   .0193/. 0026  =  7.42** 
yedia  .182/. 0026  =  70** 


Table  Values  of  F 


Ff; 


f12 


p2 


.01(**) 
5.06 
2.77 

5.31 


.05 
3.11 
2.05 

3.28 
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APPENDIX  II 


Wilcoxon  Signed-Ranks  Test  On  Times 


H  :  Photographs  =  Model 
H  :  Photographs  >  Model 


Subject 

Photographs 

Model 

(P-M) 
di 

Rank 

1 

.295 

.267 

.028 

13. 

2 

.340 

.345 

-.005 

-  3. 

3 

.392 

.370 

.022 

9. 

4 

.478 

.404 

.074 

17. 

5 

.324 

.319 

.005 

3. 

6 

.513 

.426 

.087 

18. 

7 

.338 

.280 

.058 

15. 

8 

.380 

.374 

.006 

5. 

9 

.335 

.354 

-.019 

-  8. 

10 

.428 

.405 

.023 

10.5 

11 

.252 

.265 

-.013 

-  7. 

12 

.394 

.322 

.072 

16. 

13 

.323 

.297 

.026 

12. 

14 

.334 

.332 

.002 

1. 

15 

.335 

.312 

.023 

10.5 

16 

.344 

.312 

.032 

14. 

17 

.361 

.356 

.005 

3. 

18 

.370 

.359 

.025 
40 

.011 

T  = 

N  =  18 
Table  values 
.01      .005 
33        28 

6. 
-18. 

Conclusion:  Photographs  >  Model  (.005  level) 
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H  :  Listing  =  Photographs 

H  :  Listing  >  Photographs 

(L-P) 
Subject      Listing    Photographs      di         Rank 

1  .471  .295  + 

2  .501  .340  + 

3  .559  .392  + 

4  .528  .478  + 

5  .394  .324  + 

6  .877  .513  + 

7  .474  .338  + 

8  .504  .380  + 

9  .522  .335  + 

10  .740  .428  + 

11  .326  .252  + 

12  .498  .394  + 

13  .440  .323  + 

14  .499  .334  + 

15  .432  .335  + 

16  .522  .344  + 

17  .563  .361  + 

18  .580  .370  + 

T  =  0 
N  =  18 
Table  values 
.025      .01      .005 
40       33       28 
Conclusion:  Listing  >  Photographs  (.005  level) 
Photographs  >  Model 
Listing  >  Model 
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APPENDIX  III 
Error  Calculations  for  ANOVA  of  Table  5 


■■ubjects 

Photog: 

raphs 

Model 

Lis 

ting 

Total 

X 

X2 

X 

X2 

X 

X2 

X 

X2 

1. 

2 

4 

1 

1 

9 

81 

12 

144 

2. 

1 

1 

0 

0 

0 

0 

1 

1 

3. 

1 

1 

1 

1 

3 

9 

5 

25 

4. 

1 

1 

4 

16 

3 

9 

8 

64 

5. 

2 

4 

4 

16 

32 

1024 

38 

1444 

6. 

9 

81 

6 

36 

34 

1156 

49 

2401 

7. 

0 

0 

1 

1 

7 

49 

8 

64 

8. 

2 

4 

0 

0 

12 

144 

14 

196 

9. 

2 

4 

2 

4 

9 

81 

13 

169 

10. 

1 

1 

2 

4 

8 

64 

11 

121 

11. 

6 

36 

1 

1 

0 

0 

7 

49 

12. 

8 

64 

0 

0 

12 

144 

20 

400 

13. 

1 

1 

2 

4 

2 

4 

5 

25 

14. 

5 

25 

3 

9 

10 

100 

18 

324 

15. 

1 

1 

3 

9 

4 

16 

8 

64 

16. 

3 

9 

1 

1 

19 

361 

23 

529 

17. 

1 

1 

0 

0 

3 

9 

4 

16 

18. 

5 

25 

3 

9 

20 

400 

28 

784 

totals    51     263     34     112  187    3651    272    6820 

i.verage   2.83         1.89  10.39        5.04 

X  =  Total  errors  for  a  medium  by  1  subject 
ium   X2  =  4026 
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Subjects  Sequence  Subject  total    Sequence  total 

photographs-model-listing 
7  8 

13'  5 

16  23 


photographs-listing-model  36 

1  12 
4  8 

9  13 


model-photographs-listing  33 

2  1 

6  49 
11  7 


model-listing-photographs  57 

5  38 

8  14 
17  4 


listing-photographs-model  56 

3  5 

10  11 

12  20 


listing-model-photographs  36 

14  18 

15  8 
18  28 


(sum  X)2/N  =  (272)2/54  =  1370  =  correction  factor 

Sequence 

(362+332+572+562+362+542)/9  =  1442.244 

1442.244-1370  =  72.2  =  Sum  X^ 

lotal 

4026-1370  =  2656  =  Sum  X^ 

Between  Individuals 

6820/3  -  1370  =  903  =  Sum  X^ 

B  J. 

Between  Exoerimental  Conditions 
(5l2+342+l'872)/18  =  2151.444 

2151.444-1370  =  781.4  =  Sum  X^ 
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Subjects  Within  Sequence 

Sam  x2   -  Sura  X^  =  903  -  72.2  =  830.8  = 
ox  o 


Residual  (experimental  error) 
4026-2273-781.4  =  971.6 


sum  X2g 
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Source  of  variation   df 


Sum  X^ 


ms 


Subjects  17 

Sequence  5 

Subjects  X  Sequence  12 

Madia  2 

Error  34 


72.2 
830.8 
781.4 
971.6 


72.2/5  =  14.44 
830.8/12  =  69.23 
781.4/2  =  390.70 
971.6/34  =  28.58 


F  ratios 


S  aquence 

Sabjects  x  Sequence 

Madia 


14.44/69.23   =   0.21 
69.23/28.58   =   2.42* 
390.70/28.58   =   13.67** 


Table   Values   of  F 


r>5 
^  12 

F12 
F2 


.01(**) 
5.06 
2.77 
5.31 


.05(*) 
3.11 
2.05 
3.28 
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Wilcoxon  Signed-Ranks  Test  On  Errors 


Photographs  =  Model 
Photographs  >  Model 


Model 

1 
0 
1 
4 
4 
6 
1 
0 
2 
2 
1 
0 
2 
3 
3 
1 
0 
3 


N  =  16 
Table  values 
.025     .01      .005 
30      24        20 
Conclusion:  There  is  no  sample  evidence  against  H  , 


Subject 

Photographs 

1 

2 

2 

1 

3 

1 

4 

1 

5 

2 

6 

9 

7 

0 

8 

2 

9 

2 

10 

1 

11 

6 

.12 

8 

13 

1 

14 

5 

15 

1 

16 

3 

17 

1 

18 

5 

(P-M) 
di 

Rank 

1 

3.5 

1 

0 

-3 

3.5 

-13.5 

-2 

-9.5 

3 

13.5 

-1 

-3.5 

2 

0 
-1 

9.5 

-3.5 

5 

15. 

8 

16. 

-1 

-3.5 

2 

9.5 

-2 

-9.5 

2 

9.5 

1 

3.5 

2 

9.5 

T  = 

-43. 
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H  :  Listing  =  Photographs 
H  :  Listing  >  Photographs 


ibject 

Listing 

Photographs 

(L-: 

di 

P) 

Rank 

1 

9 

2 

7 

11.5 

2 

0 

1 

-1 

-1.5 

3 

3 

1 

2 

4. 

4 

3 

1 

2 

4. 

5 

32 

2 

30 

18. 

6 

34 

9 

25 

17. 

7 

7 

0 

7 

11.5 

8 

12 

2 

10 

14. 

9 

9 

2 

7 

11.5 

10 

8 

1 

7 

11.5 

11 

0 

6 

-6 

-9. 

12 

12 

8 

4 

7. 

13 

2 

1 

1 

1.5 

14 

10 

5 

5 

8. 

15 

4 

1 

3 

6. 

16 

19 

3 

16 

16. 

17 

3 

1 

2 

4. 

18 

20 

.025 

5 

Table  value 
.01 

15 
T 

N 

s 

.005 

=  18 

15. 
-10.5 

40       33        28 
Conclusion:  Listing  >  Photographs  (.005  level) 
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F  :  Listing  = 

Model 

i    :    Listing  > 

Model 

Subject 

List 

1 

9 

2 

0 

3 

3 

4 

3 

5 

32 

6 

34 

7 

7 

8 

12 

9 

9 

10 

8 

11 

0 

12 

12 

13 

2 

14 

10 

15 

4 

16 

19 

17 

3 

18 

20 

Model 

(L-M) 
di 

Rank 

1 

8 

10. 

0 

0 



1 

2 

4. 

4 

-1 

-2. 

4 

28 

15.5 

6 

28 

15.5 

1 

6 

6.5 

0 

12 

11.5 

2 

7 

8.5 

2 

6 

6.5 

1 

-1 

-2. 

0 

12 

11.5 

2 

0 



3 

7 

8.5 

3 

1 

2. 

1 

18 

14. 

0 

3 

5. 

3 

17 

T  = 

• 

N  =  16 

13. 
-4. 

Table 

values 

025 

.01 

.005 

30 

24 

20 

Conclusion :  Listing  >  Model  (.005  level) 
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Recent  studies  have  shown  that  workers  using  35mm  color 
slide  programs  as  an  instructional  medium  for  a  production  assem- 
bly task  have  been  able  to  assemble  units  faster  and  more  accur- 
ately than  when  conventional  typewritten  instructions  were  used. 
•  Tnis  thesis  investigated  whether  or  not  the  same  effect  could  be 
ootained  without  the  use  of  projection  equipment. 

The  tasks  used  in  this  experiment  were  the  same  as  those 
used  in  the  previous  experiments.   Three  different  media  were 
used:  color  photographs,  completed  units  used  as  models,  and 
t/pewritten  listings. 

Eighteen  female  subjects  assembled  36  units  from  each  of  the 

ttiree  media. 

The  average  minutes  per  layer  for  the  model  was  0.339,  for 
tie  photographs  was  0.363,  and  for  the  listing  was  0.524.   The 
total  errors  were  model:  34,  photographs:  51,  and  listing:  187. 
Tnere  was  a  significant  difference  (alpha  =  0.01)  among  the  media. 
Tne  model  and  the  photographs  were  better  than  the  listing.   The 
model  was  also  faster  than  the  photographs  but  there  was  no  sig- 
nificant difference  in  accuracy. 


